Method and system for automated control of audio and video sources and a final composite output thereof through a video switcher

ABSTRACT

An audio and video production system and method, including a video production control switcher; and one or more computers connected through a network and configured for controlling the video production control switcher. The system is further configured for at least one of defining looks, including shot templates, that correspond to particular settings on the production control switcher or settings of parts of the production control switcher; defining sequences of the looks or assigning individual looks to control elements on a computer of the computers; transmitting the looks across the network; and translating of a single look into one or more standard editor commands, and transmitting the commands to the production control switcher.

CROSS REFERENCE TO RELATED DOCUMENTS

The present invention claims benefit of priority to U.S. ProvisionalPatent Application Ser. No. 60/556,505 of ROSS et al., entitled “METHOD,SYSTEM AND DEVICE FOR AUTOMATED CONTROL OF AUDIO AND VIDEO SOURCES AND AFINAL COMPOSITE OUTPUT THEREOF THROUGH A VIDEO SWITCHER,” filed Mar. 26,2004, the entire disclosure of which is hereby incorporated by referenceherein.

BACKGROUND

1. Field of the Invention

The exemplary embodiments of the present invention, also referred to asthe “OverDrive” system, relate to exemplary equipment (e.g., hardwareand/or software) and processes that are used to automatically createreal-time streaming video outputs or combined video and audio outputs,for example, for the broadcast industry. The exemplary embodimentsinclude a highly reliable method that can automatically control variousdevices to ultimately produce a finished video program and programaudio.

2. Discussion of the Background

Over the years, video and audio equipment has been developed. Forexample, U.S. Pat. No. 6,452,612 is directed to a method for a real timevideo production system. U.S. Pat. No. 5,450,140 is directed to a methodof using a personal computer as a base for a video production system.However, such video and audio equipment, especially professional videoand audio equipment, has become very complicated to operate, whereinproper operation of such equipment often takes years of training, andusers of the video equipment often cannot operate the audio equipmentand vice versa.

SUMMARY OF THE INVENTION

Therefore, there is a need for a method and system that addresses theabove and other problems with conventional systems and methods.Accordingly, in exemplary aspects of the present invention, an audio andvideo production system and method are provided, including a videoproduction control switcher; and one or more computers connected througha network and configured for controlling the video production controlswitcher. The system is further configured for at least one of defininglooks, including shot templates, that correspond to particular settingson the production control switcher or settings of parts of theproduction control switcher; defining sequences of the looks orassigning individual looks to control elements on a computer of thecomputers; transmitting the looks across the network; and translating ofa single look into one or more standard editor commands, andtransmitting the commands to the production control switcher.

Still other aspects, features, and advantages of the present inventionare readily apparent from the following detailed description, simply byillustrating a number of exemplary embodiments and implementations,including the best mode contemplated for carrying out the presentinvention. The present invention also is capable of other and differentembodiments, and its several details can be modified in variousrespects, all without departing from the spirit and scope of the presentinvention. Accordingly, the drawings and descriptions are to be regardedas illustrative in nature, and not as restrictive.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is illustrated by way of example, and not by wayof limitation, in the figures of the accompanying drawings and in whichlike reference numerals refer to similar elements and in which:

FIG. 1 illustrates an exemplary configuration of the present inventionconnected to a production switcher, with 2 outputs each connected to adifferent external device;

FIG. 2 illustrates an exemplary network configuration of the presentinvention, including networked computers running the production controlsoftware, connected to a network including devices and a productioncontrol switcher;

FIG. 3 illustrates a further exemplary network configuration of thepresent invention, including networked computers, running the productioncontrol software, connected to a server, which is in turn connected to aproduction switcher over a serial connection;

FIG. 4 illustrates a further exemplary network configuration of thepresent invention, including networked computers connected to theproduction switcher via a shared communication media; and

FIG. 5 illustrates an exemplary wiring configuration of the presentinvention within a production environment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

A method and system for automatically creating real-time streaming videooutputs or combined video and audio outputs, for example, for thebroadcast industry are described. In the following description, forpurposes of explanation, numerous specific details are set forth inorder to provide a thorough understanding of the present invention. Itis apparent to one skilled in the art, however, that the presentinvention can be practiced without these specific details or withequivalent arrangements. In some instances, well-known structures anddevices are shown in block diagram form in order to avoid unnecessarilyobscuring the present invention.

Automated Control of Audio/Video Devices Through a Video Switcher

In the production of a television show many devices in the studio mustinteract to produce the finished audio/video program output (see Table 1for a listing of such exemplary devices). In most audio/video productioncontrol rooms, the video switcher is the central hub. The video switcheris designed to control and, especially, coordinate, in real time or nearreal time, some of the many external devices used in a production. TABLE1 Listing of possible devices that can be found in a production controlroom and that may contribute to the creation of the final audio/videoprogram output. Production Control Room Devices Video switcher/mixersServers (VDCP/Louth Support) DDRs (Betacam Protocol) VTRs (BetacamProtocol) Audio Servers Routers DVEs (Digital Video Effect) Audio MixersRobotic Cameras Still Stores News Room Systems Serial tally devices PIPII protocol devices GPI control devices Newswire services LightingNon-Linear Editing equipment Master Control Switchers TeleprompterCharacter Generator Chroma Keyers Microphones Intercoms DVcams Recorders

Many of the above devices employ what is referred generically to as“clips.” A clip is the extra piece of information that these devicesneed to provide the correct outputs. Examples of clips and devicesinclude:

-   -   Video Servers: The clip is the name of the video server file to        play.    -   Robotic Cameras: The clip is the location of the camera.    -   VCR: The clip is the location of the tape in the VCR.

Reliability

A video switcher is recognized to be the single point of failure in thecontrol room and, as such, video switchers are designed to be robust andrecover quickly on the rare occasions that they do fail. Recovery timesare typically less than the time of a commercial break.

The exemplary embodiments (referred to as the OverDrive system) takefull advantage of these aspects of a video switcher. The exemplaryembodiments provide automation of the control room by controlling thecentral hub, the video switcher, which in turn can control much of thecontrol room equipment.

The advantages of the exemplary embodiments include:

-   -   The automation system can be easily integrated into an existing        control room.    -   The automation system can run on a less robust platform (hence        lower cost) while still allowing for a highly robust control        room since the video switcher can be used manually in the event        that the automation system fails.    -   The automation system can focus on controlling one device (e.g.,        the video switcher, and the like) rather than trying to control        many different devices itself.

Shots

The broadcast signals sent out from a video switcher are called ProgramVideo and Program Audio. During a broadcast the Program Video can be acomposite of several video signals at once. Separately, or together,during a broadcast, the Program Audio can be a composite of severalaudio signals at once. A specific combination of Program Video andProgram Audio employed for a broadcast can be referred to as a shot.

During a broadcast all of the video signals go through a videoproduction system, which is responsible for selecting inputs and mixinglayers of video together and providing the final Program Video. Thisvideo production system can be referred to as a video switcher.

During a broadcast all of the audio goes through an audio mixing system,which is responsible for selecting audio inputs and mixing the audiosignals together providing the final Program Audio. This audio mixingsystem can be referred to as an audio mixer.

Video switchers are used to assemble multiple video sources into a shot,which is broadcast live as part of a show. The video switcher can, butdoesn't always, control other video devices (e.g., the devices fromtable 1). The video switcher can also be interfaced with an audio boardand can provide automatic switching of audio. Similarly, Audio mixersare used to assemble multiple audio sources into a shot, which isbroadcast live as part of the show. The audio mixer can be, but isn'talways, controlled by the video switcher.

A number of computer applications can be used to create a description ofthe sequence of shots employed for a broadcast, called rundowns, whichcan be printed and given to the video switcher operator, and audio mixeroperator, if present. Typically, information about which devices are tobe used, and which clip is to be loaded on each device is included inthe rundown information, as well as directions as to the on-screenlocation of keys, other switcher settings, audio setting, and the like.It is up to the switcher operator(s) to create this picture, select thecorrect device(s) and cue the correct clip(s) using controls on thevideo switcher itself. This setup takes place in a very time-criticalenvironment, when the previous shot ends, the next shot must be ready togo to air to create a seamless broadcast with no gaps. Also, due to thechanging nature of live video broadcasts, shots and rundowns arefrequently changed during production of a show, resulting in the needfor frequent updates and communication between production staff and theswitcher operator to prevent the wrong shot from being taken to air.

Program Video and MLE's

The Program Video is made up of one background and a number of ‘keys’. Akey is simply one piece of video overlayed onto another. Several keysmay be overlayed on top of one background and it is commonly understoodto talk about how many keys are on air.

Video streams are sub defined into levels called Multi-Level-Effects(MLE's). Each MLE can have several keys. MLE's can be used as the inputto other MLE's thus allowing more keying layers. Thus, the ProgramOutput is the combined layering of multiple MLE's with multiple keys atonce.

Every layer of video in a video production switcher is typicallyreferred to as a bus. It is understood in the art to talk about the key2 bus or the key 1 bus which means the video in key 2 and the video inkey 1.

Shot Templates

At any given point in the broadcast a description can be given of whatis currently on air. In an exemplary embodiment, a shot template caninclude the following pieces of information:

-   -   The background video.    -   The keys overlayed on the background video.    -   The audio sources that can be heard and the volume of each audio        channel.    -   Any devices that are used as a video source to the video        switcher.    -   The clips selected on the devices currently on air.    -   Any devices that are used as an audio source to the audio mixer.    -   Video selection on program and preset video buses.    -   Video selection on all key buses that are part of the output.    -   Ability to select specific video inputs on a video bus or a        virtual video input.    -   Number of keyers that can be used for this video output. This is        not restricted to the number of keyers in an MLE but to the        number of keyers in the video switcher.    -   Whether the audio being used for this video output is standard        audio follow video or not.    -   If the audio is not the standard audio follow video then the        user is allowed to specify any audio they want.    -   The user can specify the volume independently for every audio        input.    -   Any devices that feed any of the video buses for this template.

The above with the exception of the clip information can be referred toas a shot template. Shot templates can include any or all of the aboveitems. For example, it is possible to create shot templates includingonly video elements, only audio elements, only device elements orcombinations thereof. Shot templates can also include transition effectcontrols to describe how the shot template is to be taken to air.

-   -   The user can create as many shot templates as they want. An        example of a shot template can include:    -   Shot Template Name: Cam 1 with Video Server in Over The Shoulder        Box.    -   Shot Template Number: 1003 (user selectable).    -   Background video: Cam 1.    -   Number of Keys: 1.    -   Video Source for Key 1: Video Server (Special note, this is a        device).    -   Audio Sources in use: Mic 1 at 45%, Video Server at 45%.    -   Video Effect: 8 frame Dissolve.    -   Audio Effect: 3 frame Crossfade.

Device Templates

Devices have to be configured so that the system knows how to use them.Many devices have multiple outputs that are all considered identical forpurposes of the switcher. For example, a video server may have two videooutputs, wherein the video server is capable of playing any of it'sfiles onto either outputs. For purposes of creating the on air shot,either of the outputs of the video server can be considered identical bythe video switcher.

Initial Setup

When a user creates a Device Template, they can manually enter:

-   -   The name of the device they would like to use.    -   The number of video outputs the device has.    -   The type of device (e.g., Video server vs robotic camera, and        the like).

For each video output of the device, the user can also specify the videoinput connector to which it was attached on the switcher. For example,the user might have a still store device (106) with two outputs (108,110) to the switcher (104), as illustrated in FIG. 1. When creating ashot template, the user can name the device (106), specify that it hastwo video outputs (108, 110), and that the outputs (108, 110) areconnected to switcher (104) video inputs A (112) and B (114). In FIG. 1,the OverDrive Control System (102) controls the switcher (104) via acontrol link (116). For example, in the previous section, the devicetemplate was called “Video Server.”

Shot Template Instances

Shot templates themselves are not taken to air. The user can create an“instance” of a shot template. A shot template instance is identical toa shot template except that it also includes device clip information.

The user can create as many shot template instances of the same shottemplate as they want. For example, in the previous section, the shottemplate was called “Cam 1 with Video Server in Over The Shoulder Box.”The user can create as many shot template instances of the shot templateas desired, wherein each instance can be used to specify a differentvideo clip for the system to use.

Additionally, a shot template instance can be created where the deviceclip information is intentionally left blank. When this is done, theuser can be prompted for the device clip information, when the shottemplate has been requested to go to air.

Running Video

When a shot template instance is prepared, if it includes videoelements, these elements can be set on the video switcher in a fashionwhich allows them to be previewed. If required, final changes can thenbe made to the video elements, either through controls included withinthe OverDrive system or by using the controls on the video switcheritself.

When a shot template instance is taken to air, the video switcher canuse the named video effect included in the shot template instance totransition the video elements. Video effects included in shot templatescan describe any suitable transition effect at any suitable rate that ispossible for the video switcher to perform.

Running External Devices

When a shot template instance is prepared, if it includes deviceelements, clips can be required. Clips are specific to the device, and amechanism is included in the OverDrive system to ensure that the chip isvalid for the device. The user can specify a device clip at varioustimes, for example:

-   -   In advance, when creating a rundown.    -   When the show is being played out.    -   During the creation of a shot template instance.

When playing through a rundown, the OverDrive system can automaticallyuse any suitable clips specified ahead of time. If no clip wasspecified, or if the clip is invalid, the user can be prompted for one.

Choosing a Free Device Output

When preparing a template to air, the OverDrive system can check whichdevice outputs are currently in use. The OverDrive system does this bylooking at the video input connections for the device, as specified inthe Device Template. If the device output is used by either (i) anycrosspoint of an on-air MLE or (ii) an on air internal DSK, that outputcan be considered to be in use.

The OverDrive system can look at all of the device outputs until itfinds one that is not considered to be on air. If no device outputs arefound that are not considered to be on air, then the shot template neednot be allowed to be taken to air. The OverDrive system is capable ofanalyzing shot templates and giving visual indications that a shottemplate can not be taken to air in advance of the user requesting theshot template.

Preparing a Clip

After a device input has been chosen, the OverDrive system canautomatically prepare the clip specified earlier. The device can beinstructed to provide the clip over the device output corresponding tothe selected video input on the switcher.

Taking a Device to Air

When the shot template instance including a device is taken to air, thespecified clip can be automatically played. For example, if a shottemplate instance used a video server device, a prepared clip on thatvideo server would automatically start playing at the time the shot wastaken to air.

Running Audio

When a shot template instance is prepared, if it includes audioelements, these elements can be displayed on the OverDrive system in afashion which allows them to be previewed. If required, final changescan then be made to the audio elements through controls included withinthe OverDrive system.

When a shot template instance is taken to air, the audio mixer can usethe named audio effect included in the shot template instance totransition the audio elements. Audio effects included in shot templatescan describe any suitable effect at any suitable rate that is possiblefor the audio mixer to perform, including crossfades, cuts, pans, andthe like.

Further Features of the OverDrive System

The exemplary embodiments offer a great amount of flexibility insupporting control of devices, which fall into exemplary classes:

-   -   MOS devices: Newer devices, which have support for the        industry-standard, MbS (Media Object Server) protocol.    -   “Legacy” Devices: Older devices, which are not MOS-enabled, but        which can be controlled through a variety of ad hoc, often        vendor-specific protocols.

In the exemplary embodiments, such control is abstracted further,through connection to a personal computer-based system. The OverDrivesystem exposes a single, unified, easy to use, rich computer userinterface through which both new MOS-enabled devices, and legacy non-MOScan be simultaneously used in an integrated way in the production of atelevision show.

The OverDrive system provides a communications bridge from NewsroomComputer System (NCS) software to legacy devices which those pieces ofsoftware may not be able to directly control. The NCS can communicatewith the OverDrive system using the MOS Protocol in the usual manner.The OverDrive system then translates the NCS's directives to theswitcher's specific control language and runs both the switcher andother devices connected to it. Status and other information may then besent back from the switcher and the other devices to the OverDrivesystem, where it can be communicated back to the NCS using MOS.

The OverDrive system is the first production switcher automationcontroller enabled for open MOS protocol use with currently availableNCS products. Switcher functionality is exposed inside the NCS (e.g.,including ENPS clients, INEWS clients, AutoCue clients, and the like).Thus, the following features are provided by the exemplary embodiments:

-   -   The OverDrive system provides a two-way bridge of communication        between the worlds of the NCS and the switcher hardware.    -   The NCS communicates with the OverDrive system using the        industry-standard MOS protocol.    -   The OverDrive system associates shot templates with stories        contained within the MOS rundown received from the NCS.    -   The OverDrive system then invokes specific commands via an        extended serial protocol on the switcher, to changes its        behavior in accordance with the information received via MOS.    -   Changes in device state can then be communicated back to the        switcher, and are converted and retransmitted from the switcher        to the OverDrive system. The OverDrive system can then use the        MOS protocol to inform the newsroom software of the results of        device operation.

Multiple Switcher Control Modes

The functionality of the switcher is exposed in multiple ways tomaximize flexibility and allow users options in the event of hardware orsoftware failure. The switcher can be controlled by:

-   -   A user sitting directly at the switcher panel (for old style        productions, or in an emergency if new automation functionality        fails).    -   A user sitting at the OverDrive system console, using a more        compact, simplified, task-based PC-screen user interface to        create rundowns, assemble shots, do switcher quick recalls and        custom controls, control audio, etc.    -   A user building a rundown in an NCS, dragging and dropping        objects that are essentially instructions to the switcher to        take action and change the appearance of the show into a script,        with those changes picked up by the switcher later, as the show        proceeds.

Dynamic Resource Allocation in Newsroom Automation System

In the course of airing a broadcast, switchers and other newsroomhardware have limited resources. The numbers of instances of suchresources as MLEs, cameras, video server channels, etc., available atany given instant in a program, are thus limited. The system, duringrundown creation, rearrangement and playout, can watch for conflicts instill upcoming pieces of the broadcast and either warn the user that asegment of the show has been made unable to go to air because of them,or can substitute in pre-configured fallback defaults for the faultyshot (station logo, commercial, “TECHNICAL DIFFICULTIES, DO NOT ADJUSTYOUR SET”, etc.) if the user fails to remedy the situation in time.

Real-Time Connection Between Rundown Editors and the Video Switcher

The exemplary embodiments provide a real-time connection between rundowneditors and the production control switcher across a network. As asystem including multiple networked computers, it works as an additionto an existing video production system, allowing automation of the videoswitcher. By providing a live-link between the switcher and the rundowneditor, it is possible to make changes to rundowns and stories, changedevices or clips on the fly and have a seamless communication linkbetween production and playout.

An exemplary embodiment, as shown in FIG. 2, can include one or morepersonal computers (204, 208), connected to the production switcher(206, 212) via a network link(s) (222, 224), and to one or more devices(210, 214, 216) via the same or other network links (222, 224). Devices(218, 220) to be controlled can also be connected to the productioncontrol switcher (206, 212). The devices of FIG. 2 can also be connectedto a newsroom control system (202) via the same or other network links(222, 224).

A further exemplary embodiment, as shown in FIG. 3, can include one ormore computers (302, 304) connected to the production switcher (308) viaa serial communications cable (316). The computers (302, 304) arenetworked (via server 306 and communication links 312), allowingcommunication between the computers (302, 304), as well as a rundowneditor, and the like. The computers (302, 304) offer a variety ofswitcher control options, including, preparing shots on the productioncontrol switcher (308) from a rundown published by a third partysoftware, from a pre-prepared set of shots, and the like, providingdirect control over switcher inputs and output mappings.

In a further exemplary embodiment, as shown in FIG. 4, one or morecomputers (302, 304) are connected to the production switcher via someshared communication media (312). The computers (302, 304) are networkedvia an integrated server switcher (402), and can communicate with eachother via the integrated server (306), with a third-party, with anincluded rundown editor, with the production control switcher (308), andthe like. Each computer (302, 304) can receive updates from the switcher(308) about it's state, from the rundown editor(s) about rundown state,and can be added to or leave the control network independently. Eachcomputer (302, 304) in the control network can provide instruction tothe switcher (308).

An exemplary configuration of the exemplary embodiments of the presentinvention is shown in the FIG. 5. In FIG. 5, real-time or near real-timecommunication between computers, the video switcher (206, 212), and therundown editor or other external devices (506-510) in the control room,is accomplished through a combination of Ethernet and serial networks.Switcher (206, 212) control is maintained through a server (204/208),which acts as an intermediary between the Ethernet based client machines(202, 210, 502, 504), and the serial based production control switcher(206, 212). Template or “look” control is maintained through a server,which acts as a database for collecting look information. In anexemplary embodiment, a “look” can include shot templates thatcorrespond to particular settings on the production control switcher orsettings of parts of the production control switcher.

In an exemplary embodiment, switcher communication can occur over aserial link, and the like. This link runs between the production controlswitcher, and a control PC, also referred to as the server. The link canuse commonly available serial technologies, such as RS-232,RS-422/RS-485, and the like. This link can use a standard editorprotocol.

The server is responsible for translating requests from the network sideinto editor messages, and transmitting them to the switcher. It is alsoresponsible for supplying notification to the network of any and allswitcher status changes is as timely a fashion as possible. The serveralso acts as a collection point for all look information, anddistributes change notification across the network when looks are added,modified or deleted.

The exemplary embodiments can be easily integrated into a control roomwith a minimum of disruption. The exemplary embodiments can control theequipment that is already in place without requiring extensive rewiringor the purchase of new equipment. The exemplary embodiments do this bycontrolling the video switcher, which is an essential element in allcontrol rooms.

Since the OverDrive system does not have to be as robust as a videoswitcher, it can be implemented on a desktop computer (PC). While PCsare not known for their robustness, they are a very flexible platformthat allows for a good user interface. Using a PC to host the OverDrivesystem allows for an easy-to-use system while still ensuring anessential level of robustness in the control room. In the event of afailure of the OverDrive system, the video switcher could be used tomanually take over the running of the production with a minimum ofdelay. While the video switcher is also a single point of failure, videoswitchers have been designed to take this into account. Video switchersare therefore more reliable than PCs, have a much longer MTBF (Mean TimeBefore Failure), and, if need be, can reboot significantly faster than aPC (approximately one minute for a switcher, versus several minutes fora PC).

Device control via the video switcher offers several advantages overcontrol of external devices directly from the PC running the OverDrivesystem. In most control rooms, the video switcher is already the centralhub. It is designed to control and, especially, coordinate, in realtime, the many external devices used in a production. While PCs canprovide flexibility and a good user interface, real time control is nottheir strength. Using the video switcher to provide such external devicecontrol, provides the OverDrive system with much more effective devicecontrol than if it tried to control all the devices itself. TheOverDrive system therefore only has to focus on controlling one device(e.g., the video switcher). By sending commands to the video switcherthrough the switcher's external control interface, the OverDrive systemis effectively controlling external devices in a reliable, timely andproven manner.

Much of the device setup is done on the switcher itself. The OverDrivesystem uses command messages to prepare the device for the next shot.Typical commands can include (i) cue a clip on a video server, (ii)instructing a robotic camera to ready a predetermined shot, (iii) recalla still from a still store, (iv) set up a DVE transition, and the like.The OverDrive system informs the switcher of the input location toselect to bring the desired device output to air. When the user requestsa transition, the OverDrive system sends a command to the switcher,which then performs the transition, coordinating with all suitableexternal devices, as necessary.

In an exemplary embodiment, a shot template can include various piecesof information, as previously described. In each shot, any number ofkeyers, up to the maximum number allowed in the video system, may bechosen regardless of the physical location of the keyer within thesystem. (this can be MLE independent by virtualizing the keyers). Theuser creates instances of templates for running.

All devices that are referenced in a template need clip information forthat template instance to be able to be run. A clip refers to adifferent item for each different device. Examples are: CharacterGenerator: Clip = Character Generator template with all text. RoboticCameras: Clip = Robotic camera position. Video Servers: Clip = VideoClip to play. Still Store: Clip = Still Image to play. Digital VideoEffect (DVE): Clip = Effect to play. Video Tape Recorder (VTR): Clip =Timecode on video tape to play from.

Multiple instances of the same base template can be created. Each uniqueinstance of the same base template can have different clip information.An instance of a template does not have to have clip information enteredwhen the instance is created. The clip information for some or alldevices can be left blank. All shot templates are constantly analyzedagainst what is on air by software according to the exemplaryembodiments. The number of resources currently on air is comparedagainst the number of resources in the system as a total. Shot templatesthat employ more resources than are currently available can be marked asimpossible to the user.

When a shot template is selected to play to air it does not go directlyto air but to preview. The user sees this preview in both the userinterface and on a video monitor. The user can leave the template inpreview for as long as they want verifying that all elements of the shottemplate are correct. Once the user has verified that every element onpreview is correct then they can transfer it to program.

When a shot template is selected all devices that are attached to theshot template are sent their clip information.

When a shot template is selected to play to air that has any devicesattached to it that have blank clip information in the templateinstance, the user can be prompted through the graphical user interface(GUI) for this clip information during the running of the show.

The user can create visual banks of shot template instantiations intheir user interface.

The user can create a list of shot templates instantiations and storeand recall these lists.

The user when producing a show can choose to load a sequential list ofshot templates to play. When this list is loaded the user can simplyelect to play one-shot template in the list after another or can selectto play the shot templates in any order. The timing playout of this listcan be automated or handled manually.

When the user is sequentially going through the shot templates from alist the user can opt to run any shot template instantiation they wouldlike instead of the next shot template in the list.

The shot templates that are created in a computer system are duplicatedin the video production switcher.

The shot templates can be run from the video production hardware's userinterfaced (usually referred to the switcher panel) as well as from thecomputer based system.

The devices and subsystems of the exemplary embodiments described withrespect to FIGS. 1-5 can communicate, for example, over a communicationsnetwork, and can include any suitable servers, workstations, personalcomputers (PCs), laptop computers, PDAs, Internet appliances, set topboxes, modems, handheld devices, telephones, cellular telephones,wireless devices, other devices, and the like, capable of performing theprocesses of the disclosed exemplary embodiments. The devices andsubsystems, for example, can communicate with each other using anysuitable protocol and can be implemented using a general-purposecomputer system, and the like. One or more interface mechanisms can beemployed, for example, including Internet access, telecommunications inany suitable form, such as voice, modem, and the like, wirelesscommunications media, and the like. Accordingly, the communicationsnetwork can include, for example, wireless communications networks,cellular communications networks, satellite communications networks,Public Switched Telephone Networks (PSTNs), Packet Data Networks (PDNs),the Internet, intranets, hybrid communications rietworks, combinationsthereof, and the like.

As noted above, it is to be understood that the exemplary embodiments,for example, as described with respect to FIGS. 1-5, are for exemplarypurposes, as many variations of the specific hardware and/or softwareused to implement the disclosed exemplary embodiments are possible. Forexample, the functionality of the devices and the subsystems of theexemplary embodiments can be implemented via one or more programmedcomputer systems or devices. To implement such variations as well asother variations, a single computer system can be programmed to performthe functions of one or more of the devices and subsystems of theexemplary systems. On the other hand, two or more programmed computersystems or devices can be substituted for any one of the devices andsubsystems of the exemplary embodiments. Accordingly, principles andadvantages of distributed processing, such as redundancy, replication,and the like, also can be implemented, as desired, for example, toincrease the robustness and performance of the exemplary embodimentsdescribed with respect to FIGS. 1-5.

The exemplary embodiments described with respect to FIGS. 1-5 can beused to store information relating to various processes describedherein. This information can be stored in one or more memories, such asa hard disk, optical disk, magneto-optical disk, RAM, and the like, ofthe devices and sub-systems of the exemplary embodiments. One or moredatabases of the devices and subsystems can store the information usedto implement the exemplary embodiments. The databases can be organizedusing data structures, such as records, tables, arrays, fields, graphs,trees, lists, and the like, included in one or more memories, such asthe memories listed above.

All or a portion of the exemplary embodiments described with respect toFIGS. 1-5 can be conveniently implemented using one or moregeneral-purpose computer systems, microprocessors, digital signalprocessors, micro-controllers, and the like, programmed according to theteachings of the disclosed invention. Appropriate software can bereadily prepared by programmers of ordinary skill based on the teachingsof the disclosed exemplary embodiments. In addition, the exemplaryembodiments can be implemented by the preparation ofapplication-specific integrated circuits or by interconnecting anappropriate network of component circuits.

While the present invention have been described in connection with anumber of exemplary embodiments and implementations, the presentinvention is not so limited but rather covers various modifications andequivalent arrangements, which fall within the purview of the appendedclaims.

1. An audio and video production system, the system comprising: a videoproduction control switcher; and one or more computers connected througha network and configured for controlling the video production controlswitcher; wherein the system is further configured for at least one of:defining looks, including shot templates, that correspond to particularsettings on the production control switcher or settings of parts of theproduction control switcher; defining sequences of the looks orassigning individual looks to control elements on a computer of thecomputers; transmitting the looks across the network; and translating ofa single look into one or more standard editor commands, andtransmitting the commands to the production control switcher.
 2. Thesystem of claim 1, wherein the system is further configured for allowingone or multiple users to co-operatively define the looks, including:allowing multiple users to work on creating or editing a multitude ofthe looks on separate computers who receive updates from each otherautomatically when a user changes, adds or deletes an individual look.3. The system of claim 1, wherein the system is further configured forallowing one or multiple users to co-operatively define sequences of thelooks, including at least one of: allowing multiple users to work oncreating or editing a particular sequence on separate computers whoreceive updates from each other automatically when a user changes thesequence of looks or the definition of an individual look or thetotality of created looks; and allowing multiple users to work oncreating or editing a multitude of sequences on separate computers whoreceive updates from each other automatically when any user changes thedefinition of an individual look or the totality of created looks. 4.The system of claim 1, wherein the system is further configured forallowing one or multiple users to transmit a look across the network,causing the look to be prepared on the production control switcher. 5.The system of claim 1, wherein individual looks are assigned to controlelements on a computer, and transmitted when a control element isactivated.
 6. The system of claim 1, including a computer user interfacecomprising a number of control elements to which are assigned individuallooks or sequences or one or more production control switcher commands,and the system is configured for at least one of: displaying looks usingan icon attached to a control element or visual picture which representsa video output resulting from the preparation of the look; color codingfor the control elements which represent a completeness of a look, andwhether or not the look can currently be prepared on a productioncontrol switcher; color-coding for the control elements that representsequences of looks which represent a completeness of each look includedin a sequence and whether or not each look is preparable when thesequence is followed; and controlling playback of a sequence, wherein auser prepares a look in a sequence on the production switcher,transition a look, and prepare a next look in a sequence using one ormore of the control elements.
 7. The system of claim 1, wherein thesystem is further configured for defining, creating, and operationallyusing audio and video output comprised of video and audio streams,including shot templates.
 8. The system of claim 1, wherein the systemis further configured for providing automation of audio and videoproduction systems with minimum disruption to existing manual usage ofthe systems.
 9. The system of claim 1, wherein the system is furtherconfigured for providing automated control of peripheral devices for anaudio and video production system without making an automation system asingle point of failure.
 10. The system of claim 1, wherein the systemis further configured for using shot templates in both a videoproduction system and a desktop PC computer based system, includingrunning the shot templates using either the video production system orthe desktop PC, and using both the video production system and thedesktop PC during a video production.
 11. The system of claim 1, whereinthe system is further configured for defining a video and output streamthat is dependent upon a composite output.
 12. The system of claim 1,wherein the system is further configured for defining an output streamdependent on third party equipment, including defining the third partyequipment in a virtual system without employing a physical mapping. 13.The system of claim 1, wherein the system is further configured forusing shot templates during a production on an as needed basis mode orin a user defined sequential order mode with the ability to mix the twomodes.
 14. The system of claim 1, wherein the system is furtherconfigured for processing audio, including running audio using an on airand preview paradigm.
 15. The system of claim 1, wherein the system isfurther configured for allowing for control of MOS-protocol enabledevices, and allowing for control of older or legacy non-MOS devices.16. The system of claim 1, wherein the system is further configured forproviding a communications bridge that takes at one end MOS-protocolmessages and commands from an NCS system, including at least one of:taking direct action based on some of the MOS-protocol messages and thecommands from the NCS system; commanding a switcher to perform specifictasks based on other of the MOS-protocol messages and the commands fromthe NCS system; and translating the MOS-protocol messages and thecommands from the NCS system into a form that is consumed by legacy,non-MOS devices, whereby the legacy, non-MOS devices participate in amodern, MOS-enabled, studio environment.
 17. The system of claim 1,wherein the system is further configured for providing a communicationsbridge configured for receiving status and other information fromlegacy, non-MOS devices, and translating the status and the otherinformation into MOS messages before passing the status and the otherinformation back to the NCS.
 18. The system of claim 1, wherein thesystem is further configured for controlling the production switcher,including using a MOS-protocol with an NCS system of a vendor.
 19. Thesystem of claim 1, wherein the system is further configured forcontrolling the production switcher, including integrating theproduction switcher with an NCS system of a vendor.
 20. The system ofclaim 1, wherein the system is further configured for exposingfunctionality of the production switcher and legacy devices connecteddownstream to an NCS user putting together a show.
 21. The system ofclaim 1, wherein the system is further configured for allowing featuresto be used during production of a script, wherein different switcherconfigurations and operations produce a look of a broadcast at a momentin a script and are assembled using a component that integrates into NCSsoftware.
 22. The system of claim 1, wherein the system is furtherconfigured for allowing smooth failover in an event of failures of NCShardware or software or a network environment thereof.
 23. The system ofclaim 1, wherein the system is further configured for allowing a user totake control of the production switcher at one of a PC-based userinterface of a computer console, and a physical console of theproduction switcher.
 24. The system of claim 1, wherein the system isfurther configured for continuous updated tracking of a condition,status, and availability of production devices in a television studio,including cameras, audio boards, switchers, video servers, and CGs. 25.The system of claim 1, wherein the system is further configured forautomated monitoring of resource availability as device settings changethroughout a broadcast.
 26. The system of claim 1, wherein the system isfurther configured for analyzing of device status information; andproviding a computerized plan for a partially or fully automated programrundown to detect in advance resource conflicts where devices orfeatures thereof are not simultaneously usable.
 27. The system of claim26, wherein the system is further configured for warning an operatorthat the conflicts are going to occur.
 28. The system of claim 26,wherein the system is further configured for providing a PC-based userinterface allowing the conflicts to be resolved and avoided.
 29. Thesystem of claim 1, wherein the system is implemented with one or morehardware and/or software devices.
 30. An audio and video productionmethod, the method comprising: providing a video production controlswitcher; and providing one or more computers connected through anetwork and configured for controlling the video production controlswitcher; wherein the method further includes at least one of: defininglooks, including shot templates, that correspond to particular settingson the production control switcher or settings of parts of theproduction control switcher; defining sequences of the looks orassigning individual looks to control elements on a computer of thecomputers; transmitting the looks across the network; and translating ofa single look into one or more standard editor commands, andtransmitting the commands to the production control switcher.
 31. Themethod of claim 30, further comprising allowing one or multiple users toco-operatively define the looks, including: allowing multiple users towork on creating or editing a multitude of the looks on separatecomputers who receive updates from each other automatically when a userchanges, adds or deletes an individual look.
 32. The method of claim 30,further comprising allowing one or multiple users to co-operativelydefine sequences of the looks, including at least one of: allowingmultiple users to work on creating or editing a particular sequence onseparate computers who receive updates from each other automaticallywhen a user changes the sequence of looks or the definition of anindividual look or the totality of created looks; and allowing multipleusers to work on creating or editing a multitude of sequences onseparate computers who receive updates from each other automaticallywhen any user changes the definition of an individual look or thetotality of created looks.
 33. The method of claim 30, furthercomprising allowing one or multiple users to transmit a look across thenetwork, causing the look to be prepared on the production controlswitcher.
 34. The method of claim 30, further comprising: assigningindividual looks to control elements on a computer; and transmitting theassigned looks when a control element is activated.
 35. The method ofclaim 30, further comprising providing a computer user interfaceincluding a number of control elements to which are assigned individuallooks or sequences or one or more production control switcher commands,and at least one of: displaying looks using an icon attached to acontrol element or visual picture which represents a video outputresulting from the preparation of the look; color coding for the controlelements which represent a completeness of a look, and whether or notthe look can currently be prepared on a production control switcher;color-coding for the control elements that represent sequences of lookswhich represent a completeness of each look included in a sequence andwhether or not each look is preparable when the sequence is followed;and controlling playback of a sequence, wherein a user prepares a lookin a sequence on the production switcher, transition a look, and preparea next look in a sequence using one or more of the control elements. 36.The method of claim 30, further comprising defining, creating, andoperationally using audio and video output comprised of video and audiostreams, including shot templates.
 37. The method of claim 30, furthercomprising providing automation of audio and video production systemswith minimum disruption to existing manual usage of the systems.
 38. Themethod of claim 30, further comprising providing automated control ofperipheral devices for an audio and video production system withoutmaking an automation system a single point of failure.
 39. The method ofclaim 30, further comprising using shot templates in both a videoproduction system and a desktop PC computer based system, includingrunning the shot templates using either the video production system orthe desktop PC, and using both the video production system and thedesktop PC during a video production.
 40. The method of claim 30,further comprising defining a video and output stream that is dependentupon a composite output.
 41. The method of claim 30, further comprisingdefining an output stream dependent on third party equipment, includingdefining the third party equipment in a virtual system without employinga physical mapping.
 42. The method of claim 30, further comprising usingshot templates during a production on an as needed basis mode or in auser defined sequential order mode with the ability to mix the twomodes.
 43. The method of claim 30, further comprising processing audio,including running audio using an on air and preview paradigm.
 44. Themethod of claim 30, further comprising allowing for control ofMOS-protocol enable devices, and allowing for control of older or legacynon-MOS devices.
 45. The method of claim 30, further comprisingproviding a communications bridge that takes at one end MOS-protocolmessages and commands from an NCS system, including at least one of:taking direct action based on some of the MOS-protocol messages and thecommands from the NCS system; commanding a switcher to perform specifictasks based on other of the MOS-protocol messages and the commands fromthe NCS system; and translating the MOS-protocol messages and thecommands from the NCS system into a form that is consumed by legacy,non-MOS devices, whereby the legacy, non-MOS devices participate in amodern, MOS-enabled, studio environment.
 46. The method of claim 30,further comprising providing a communications bridge configured forreceiving status and other information from legacy, non-MOS devices, andtranslating the status and the other information into MOS messagesbefore passing the status and the other information back to the NCS. 47.The method of claim 30, further comprising controlling the productionswitcher, including using a MOS-protocol with an NCS system of a vendor.48. The method of claim 30, further comprising controlling theproduction switcher, including integrating the production switcher withan NCS system of a vendor.
 49. The method of claim 30, furthercomprising exposing functionality of the production switcher and legacydevices connected downstream to an NCS user putting together a show. 50.The method of claim 30, further comprising allowing features to be usedduring production of a script, wherein different switcher configurationsand operations produce a look of a broadcast at a moment in a script andare assembled using a component that integrates into NCS software. 51.The method of claim 30, further comprising allowing smooth failover inan event of failures of NCS hardware or software or a networkenvironment thereof.
 52. The method of claim 30, further comprisingallowing a user to take control of the production switcher at one of aPC-based user interface of a computer console, and a physical console ofthe production switcher.
 53. The method of claim 30, further comprisingcontinuous updated tracking of a condition, status, and availability ofproduction devices in a television studio, including cameras, audioboards, switchers, video servers, and CGs.
 54. The method of claim 30,further comprising automated monitoring of resource availability asdevice settings change throughout a broadcast.
 55. The method of claim30, further comprising: analyzing of device status information; andproviding a computerized plan for a partially or fully automated programrundown to detect in advance resource conflicts where devices orfeatures thereof are not simultaneously usable.
 56. The method of claim55, further comprising warning an operator that the conflicts are goingto occur.
 57. The method of claim 55, further comprising providing aPC-based user interface allowing the conflicts to be resolved andavoided.
 58. The method of claim 30, wherein the method is implementedwith a computer-readable medium including computer-readable instructionsembedded therein and configured to cause one or more computer processorsto perform the steps recited in claim
 30. 59. The method of claim 30,wherein the method is implemented with a computer system having one ormore hardware and/or software devices configured to perform the stepsrecited in claim
 30. 60. A computer-readable medium includingcomputer-readable instructions embedded therein for audio and videoproduction and configured to cause one or more computer processors toperform the steps of: providing a video production control switcher;providing one or more computers connected through a network andconfigured for controlling the video production control switcher; and atleast one of: defining looks, including shot templates, that correspondto particular settings on the production control switcher or settings ofparts of the production control switcher; defining sequences of thelooks or assigning individual looks to control elements on a computer ofthe computers; transmitting the looks across the network; andtranslating of a single look into one or more standard editor commands,and transmitting the commands to the production control switcher. 61.The computer readable medium of claim 60, further comprisingcomputer-readable instructions configured to cause the one or morecomputer processors to perform the steps of allowing one or multipleusers to co-operatively define the looks, including: allowing multipleusers to work on creating or editing a multitude of the looks onseparate computers who receive updates from each other automaticallywhen a user changes, adds or deletes an individual look.
 62. Thecomputer readable medium of claim 60, further comprisingcomputer-readable instructions configured to cause the one or morecomputer processors to perform the steps of allowing one or multipleusers to co-operatively define sequences of the looks, including atleast one of: allowing multiple users to work on creating or editing aparticular sequence on separate computers who receive updates from eachother automatically when a user changes the sequence of looks or thedefinition of an individual look or the totality of created looks; andallowing multiple users to work on creating or editing a multitude ofsequences on separate computers who receive updates from each otherautomatically when any user changes the definition of an individual lookor the totality of created looks.
 63. The computer readable medium ofclaim 60, further comprising computer-readable instructions configuredto cause the one or more computer processors to perform the steps ofallowing one or multiple users to transmit a look across the network,causing the look to be prepared on the production control switcher. 64.The computer readable medium of claim 60, further comprisingcomputer-readable instructions configured to cause the one or morecomputer processors to perform the steps of: assigning individual looksto control elements on a computer; and transmitting the assigned lookswhen a control element is activated.
 65. The computer readable medium ofclaim 60, further comprising computer-readable instructions configuredto cause the one or more computer processors to perform the steps ofproviding a computer user interface including a number of controlelements to which are assigned individual looks or sequences or one ormore production control switcher commands, and at least one of:displaying looks using an icon attached to a control element or visualpicture which represents a video output resulting from the preparationof the look; color coding for the control elements which represent acompleteness of a look, and whether or not the look can currently beprepared on a production control switcher; color-coding for the controlelements that represent sequences of looks which represent acompleteness of each look included in a sequence and whether or not eachlook is preparable when the sequence is followed; and controllingplayback of a sequence, wherein a user prepares a look in a sequence onthe production switcher, transition a look, and prepare a next look in asequence using one or more of the control elements.
 66. The computerreadable medium of claim 60, further comprising computer-readableinstructions configured to cause the one or more computer processors toperform the steps of defining, creating, and operationally using audioand video output comprised of video and audio streams, including shottemplates.
 67. The computer readable medium of claim 60, furthercomprising computer-readable instructions configured to cause the one ormore computer processors to perform the steps of providing automation ofaudio and video production systems with minimum disruption to existingmanual usage of the systems.
 68. The computer readable medium of claim60, further comprising computer-readable instructions configured tocause the one or more computer processors to perform the steps ofproviding automated control of peripheral devices for an audio and videoproduction system without making an automation system a single point offailure.
 69. The computer readable medium of claim 60, furthercomprising computer-readable instructions configured to cause the one ormore computer processors to perform the steps of using shot templates inboth a video production system and a desktop PC computer based system,including running the shot templates using either the video productionsystem or the desktop PC, and using both the video production system andthe desktop PC during a video production.
 70. The computer readablemedium of claim 60, further comprising computer-readable instructionsconfigured to cause the one or more computer processors to perform thesteps of defining a video and output stream that is dependent upon acomposite output.
 71. The computer readable medium of claim 60, furthercomprising computer-readable instructions configured to cause the one ormore computer processors to perform the steps of defining an outputstream dependent on third party equipment, including defining the thirdparty equipment in a virtual system without employing a physicalmapping.
 72. The computer readable medium of claim 60, furthercomprising computer-readable instructions configured to cause the one ormore computer processors to perform the steps of using shot templatesduring a production on an as needed basis mode or in a user definedsequential order mode with the ability to mix the two modes.
 73. Thecomputer readable medium of claim 60, further comprisingcomputer-readable instructions configured to cause the one or morecomputer processors to perform the steps of processing audio, includingrunning audio using an on air and preview paradigm.
 74. The computerreadable medium of claim 60, further comprising computer-readableinstructions configured to cause the one or more computer processors toperform the steps of allowing for control of MOS-protocol enabledevices, and allowing for control of older or legacy non-MOS devices.75. The computer readable medium of claim 60, further comprisingcomputer-readable instructions configured to cause the one or morecomputer processors to perform the steps of providing a communicationsbridge that takes at one end MOS-protocol messages and commands from anNCS system, including at least one of: taking direct action based onsome of the MOS-protocol messages and the commands from the NCS system;commanding a switcher to perform specific tasks based on other of theMOS-protocol messages and the commands from the NCS system; andtranslating the MOS-protocol messages and the commands from the NCSsystem into a form that is consumed by legacy, non-MOS devices, wherebythe legacy, non-MOS devices participate in a modern, MOS-enabled, studioenvironment.
 76. The computer readable medium of claim 60, furthercomprising computer-readable instructions configured to cause the one ormore computer processors to perform the steps of providing acommunications bridge configured for receiving status and otherinformation from legacy, non-MOS devices, and translating the status andthe other information into MOS messages before passing the status andthe other information back to the NCS.
 77. The method of claim 30further comprising computer-readable instructions configured to causethe one or more computer processors to perform the steps of controllingthe production switcher, including using a MOS-protocol with an NCSsystem of a vendor.
 78. The computer readable medium of claim 60,further comprising computer-readable instructions configured to causethe one or more computer processors to perform the steps of controllingthe production switcher, including integrating the production switcherwith an NCS system of a vendor.
 79. The computer readable medium ofclaim 60, further comprising computer-readable instructions configuredto cause the one or more computer processors to perform the steps ofexposing functionality of the production switcher and legacy devicesconnected downstream to an NCS user putting together a show.
 80. Thecomputer readable medium of claim 60, further comprisingcomputer-readable instructions configured to cause the one or morecomputer processors to perform the steps of allowing features to be usedduring production of a script, wherein different switcher configurationsand operations produce a look of a broadcast at a moment in a script andare assembled using a component that integrates into NCS software. 81.The computer readable medium of claim 60, further comprisingcomputer-readable instructions configured to cause the one or morecomputer processors to perform the steps of allowing smooth failover inan event of failures of NCS hardware or software or a networkenvironment thereof.
 82. The computer readable medium of claim 60,further comprising computer-readable instructions configured to causethe one or more computer processors to perform the steps of allowing auser to take control of the production switcher at one of a PC-baseduser interface of a computer console, and a physical console of theproduction switcher.
 83. The computer readable medium of claim 60,further comprising computer-readable instructions configured to causethe one or more computer processors to perform the steps of continuousupdated tracking of a condition, status, and availability of productiondevices in a television studio, including cameras, audio boards,switchers, video servers, and CGs.
 84. The computer readable medium ofclaim 60, further comprising computer-readable instructions configuredto cause the one or more computer processors to perform the steps ofautomated monitoring of resource availability as device settings changethroughout a broadcast.
 85. The computer readable medium of claim 60,further comprising computer-readable instructions configured to causethe one or more computer processors to perform the steps of: analyzingof device status information; and providing a computerized plan for apartially or fully automated program rundown to detect in advanceresource conflicts where devices or features thereof are notsimultaneously usable.
 86. The method of claim 85, further comprisingcomputer-readable instructions configured to cause the one or morecomputer processors to perform the steps of warning an operator that theconflicts are going to occur.
 87. The method of claim 85, furthercomprising computer-readable instructions configured to cause the one ormore computer processors to perform the steps of providing a PC-baseduser interface allowing the conflicts to be resolved and avoided.